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Abstract 

A stochastic dynamical system represented through a hnear vec- 
tor equation in idempotent algebra is considered. We propose simple 
bounds on the mean growth rate of the system state vector, and give 
an analysis of absolute error of a bound. As an illustration, numerical 
results of evaluation of the bounds for a test system are also presented. 
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1 Introduction 

The evolution of actual systems encountered in economics, management, 
and engineering can frequently be represented as stochastic linear dynamic 
equations in idempotent algebra 51(2]. In many cases, analysis of the system 
can involve evaluation of the asymptotic growth rate of the system state 
vector. However, the exact evaluation of the growth rate normally appears 
to be a hard problem. The exact solution is known only for systems with 2- 
dimensional state space [J, systems with a triangular state transition matrix 
[3], and some others. 

In this paper, we propose simple bounds on the asymptotic (mean) 
growth rate, which can be considered as a generalization for bounds in 0]. 
We start with a brief overview of related algebraic results including some 
matrix inequalities. Based on these inequalities, both upper and low bounds 
are derived, and an analysis of the absolute error of an upper bound is given. 
As an illustration, numerical results of evaluation of the bounds for a test 
system are also presented. 
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2 Idempotent Algebra and Related Results 



We consider an idempotent algebra (idempotent semifield with a null ele- 
ment) with addition x © y = max(x, y) and multiplication x ® y = x + y 
defined for all x and y from the extended set of real numbers = IR U {e} , 
where e = — oo. 

Clearly, the numbers e and present null and identity elements of the 
algebra. For any x G R, one can define its inverse x~^ that is equal to —x 
in conventional algebra, and the power x'^ , which corresponds to arithmetic 
product ax for all a G IR. In the case that x = £, it is convenient to set 

x~^ = e. 

The matrix operations and (8) are introduced in the usual way through 
their scalar counterparts. The matrix £ involving only e presents the null 
matrix, and E = diag(0, . . . , 0) with all off-diagonal entries being equal to 
£ is the identity. 

Any nonnegative integer power of a square matrix A is determined by 
the relations: = E and A^ ® A"^ = A^^"^ for all integers l,m > 1. 
In what follows, the exponential notations will be used only in the sense 
of idempotent algebra. However, for simplicity sake, we will sometimes 
represent the power of a number in the form of its equivalent arithmetic 
product. 

For any matrix A = (aij) , we introduce the matrix A~ with entries 
o^- = aj^ . Similarly, for any vector x = (xi, . . . , x^)-^ , we have x~ = 
(x-^ , • • • , x„ ) . 

The operation (g) is monotonic; that is, from the inequalities A < C and 

B <D,it follows that Ai^ B <C D. 

For any matrices A G IR^'^'' and B G IR"'^'' , and = (0, . . . , 0)^ , it holds 

A®B>A^O^{B~®0)~. (1) 

Consider a matrix A = (aij) G IR"^", and introduce the symbols: 

P||= a,j, tv{A) = ^au. 

l<i,j<n 1=1 

For any A,B e R^^", if A < B then ||^|| < \\B\\. Furthermore, it holds 
that 

P(8) B|| < Pll (g) ||c(g) A|| = c(g) ||yl|| for all cG Re. 

If ^ G R^''" and B G R"''", we also have 

\\A®B\\ > \\A\\ ® \\B-\\-\ 
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The key result of the spectral theory in idempotent algebra is as follows 
[5l[6]: for any matrix A € R"^*^, it holds that 

n 

lim WA'^W^/'' = p{A) = ffi tri/™(A™), (2) 

fc— >-oo 

m=l 

where p{A) is the spectral radius of A. 

Let us now consider random matrices taking their values in R^^". For 
any random matrix A, we use the symbol E[A] to denote the matrix ob- 
tained from A by replacing all its entries with their expected values, pro- 
vided that E[e] = e. 

For any random matrices A and B , it holds that 

EPIl > ||E[^]||, E[A(E)B] > E[A] (g) E[B]. 
Furthermore, let the matrices A and B be independent. Then we have 
E||Ao5|| > E||A® E[B]||. 
If, in addition, the entries of B are finite with probability 1 (w.p. 1), then 

E||A(8)S|| > Epil (g) ||E(S0O)"|r^ > EPIl ||E[S"]||"^ (3) 

3 Stochastic Dynamical Systems 

Consider a dynamical system governed by the equation 

x{k) = A^{k)^x{k-1), (4) 

where x{k) is a state vector, A(k) is a random state transition matrix. 

We assume that the matrices A{k), k = 1,2, . . . , are independent and 
identically distributed, and that the mean value EP(1)|| is finite. 

Let us define the mean (asymptotic) growth rate of the system state 
vector as 

A= lim \\x{k)\\^/'' . 

Assuming the entries of the initial vector a;(0) to be finite w.p. 1, one 
can represent A in the form 

A= lim Pfef/^ 

where 

Ak = A{1) (g) • • -^Aik). 

It can be shown (e.g., with the ergodic theorem in [7]) that for the system 
under consideration, the above limit exists w.p. 1. Moreover, there exists 
the limit 

lim EPfcf/'^ = A. 
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The last result will be used in subsequent sections to derive bounds on 

A. 

As an example, we consider a test system ^ with random (2 x 2)- 
matrix A(k) with independent entries, each having the exponential proba- 
bility distribution of mean 1. It is known (see, e.g. [1]) that for the system, 
A = 407/228 ^ 1.7851. 

To illustrate the bounds presented bellow, we need to know the means 
of the entries {Am)ij , row maxima {Am (8) 0)i , and the overall maximum 
ll^mll of the matrix Am- Evaluation of the means for m = 1,2,3, gives us 
the following results 



1, 



Epi0O),] = 1.5, 



Epill = ^ ~ 2.0833, 



1 1 q 833 
\E[{A2)ij] = 2.75, E[(A2 ® 0)i] = — « 3.3056, Epsll = iztt: ~ 3.8565, 

6b 216 



245 



^iA3)^,] = —r^ 4.5370 



54 



1649 

E[(A3 0)i] = 5.0895, 



324 



EU, 



21937 
3888 



5.6422. 



Note that it is easy to get the means when m < 2. However, the 
evaluation rapidly grows in computational complexity as m becomes greater 
than 2. 



4 Straightforward Low and Upper Bounds 

We start with simple low and upper bounds which are valid for systems with 
any matrix Ai having a finite mean value E||Ai|| . 

Lemma 1. For any integer m>l, it holds 

pi/'"(E[yl^])<A<E||yl^||V-. (5) 

Proof. In order to verify ([5]) , let us first put m = 1 , and note that 



E[A{i)] 



i=l 



< EWAkW < E 



.1=1 



ElUill^ 



It remains to divide the above double inequality by k, and proceed to 
get limits. With ([2]) applied to the left side, we immediately arrive at 

p(E[^i]) < A < E||Ai||. 

The case of arbitrary m > 1 can be considered in a similar way. □ 

Table [1] presents results of evaluating the bounds for the test problem. 
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Bounds 


m 


m 


1 


2 


3 


Upper 


2.0833 


1.9282 


1.8807 


Low 


1.0000 


1.3750 


1.5123 



Table 1: Bounds evaluated according to ([5]). 



5 Low Bounds for Finite Matrices 



Suppose now that all the entries of the matrix Ai are greater than e w.p. 1. 

Lemma 2. For any integer m>l, it holds 

A> ||E(A„^0)-|ri/™. (6) 

Proof. In the case that m = 1 , we apply ([3]) to write 

EPfcll > Epill CS> MAi 0)-|r(^~i), 

and then get the inequality 

A> ||E(>li^O)-|r\ 

which can easily be extended to arbitrary integer m > 1 in the form of 
©■ □ 

Evaluation of the bounds for m = 1,2,3, gives us: 1.5000, 1.6528, and 
1.6965. 



Lemma 3. For any integers l,m>l, it holds 

A> E||(E[^^-]^O)-0^„||i/('+"^). 



(7) 



Proof. Let us prove the inequality for I = m = 1. Setting k = 2s, one can 
apply (dJ to get 



Ell^frll > E 



A{2i - 1) O (g) (E[^"(2i)] ® 0) 



4 = 1 



E\\A{1) (g) 0|| ® E 



(g)(E[A-(2i)] ® 0)- <S) {A{2i + 1) 0) 



1=1 



I. 



O ||(E[.4-(A:)] ®0)-|| 

= E\\Ai oii o E[(E[A^] ® 0)- ® 0]"-^ ® wm^i] ^ 

The last inequality leads us to 

A > E[{E[A^]0O)- ^Ai0O]^/^ = E\\{E[A^]^0)' 0Ai\\^^^. 

In a similar manner, inequality ([7]) can be derived for arbitrary l,m > 

□ 
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Examples related to evaluation of the low bound are presented in Table[2j 



Low Bound 


m 




m 


1 


2 


3 




1 


1.5417 


1.6188 


1.6606 




2 


1.6111 


1.6516 


1.6784 




3 


1.6551 


1.6787 


1.6965 



Table 2: Examples of low bounds ([7]). 



As one can see, the accuracy of bounds Q when m = 1, 2, 3, are quite 
comparable to that of bounds ([7]). Note, however, that in order to achieve 
the same accuracy, the first bound involves less computational efforts than 
the second. 

We conclude this section with a result to be used in the error analysis 
below. 

Corollary 4. For any integer m > 1, it holds 

A>(||E[A7]|ri®Ep„_i||)V-. (8) 

Proof. In order to verify inequality ([S]) for m = 1 , first note that 

mA,\\>mA,]n>mA^]\\-\ 

and therefore, A > HEfAj"]!!-! = ||E[A^]||-i (g) Epoll, where = E. 
For any m > 1, the inequality results from d?]): 

A> E||(E[^r]»0)-®A„_if/™ > (||E[Ar]|r^0Ep™_i||)i/'". □ 

6 An Error Analysis 

Consider the absolute error 

em = — EP^II - A, 
m 

which represents the difference between A and its approximation E||j4m||^'^'" . 

Assuming the entries of Ai to be finite w.p. 1, we have the following 
result. 

Lemma 5. For each m>l, it holds 

6m ^ — C, 
m 

where C = E||Ai|| + ||E[^^]|| = Epi|| ® ||E[.4f]|| . 
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Proof. By applying the obvious inequality: E||ylm|| < E||yli|| EH^m-iH) 
combined with ([8|), we have 

em < -m\Ai\\ + Ep„_i||) - -{\\\E[A^]\\-^ + E||A„_i||) 
m m 

= -(Epiii + iiE[Ar]ii) = -(EPiii ® iiE[^r]ii)- □ 

m m 

Let us compute the constant C for the test problem. Since E||j4i|[ = 
25/12, ||E[Aj;]|| = -1, we have C = 13/12 k, 1.0833. 

As it is easy to see, in the test example, the above error bound consid- 
erably overestimates the actual error at least for m = 1, 2, 3. 
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